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ABSTRACT^ * ' k c ; . - 

0 A third party evaluation was conducted of an 

experiment in service^ training program (Project Interact) in career ~ 
education using duplex (two-vay) television 'to reach several grjoups 
in different cities simultaneously. Two main aspects of the project 
were under study: the particular curriculum content on career 
education and the use of the Texas Telecomputer Grid. The Texas 
Telecomputer Grid, a telecommunication network, is operated by 
Central Texas College ^in Killeen, Texas. Satellite facilities are 
located in Dallas, Fort 'Worth, atfd San Antonio, Texas. The project 
evaluation 1 relied on- two main inputs: questionnaires completed 
periodically by the participating teachers and review of the programs 
by an 'advisory committee of media and career education expert^. , 
Results indicated that staff dedication was high, but that the 
program was impaired by. mechanical failures' of the Grid. It was 
concluded that the Grid is a useful teacher -training device for 
certain purposes an&'uridfer certain conditions*.. An appendix includ^s- 
examples of all t«he instruments employed in the evaluation. ' W 
(AutKor/SL) " \ ' ' ' » * , • 
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ABSTRACT 

This is an evaluation report of an experimental^nservice training 

• // 

program on career,, education using duplex (two-w^f television to several graGps* 

located in different cities, . simultaneously , Jibere were two main unknown ouan- 

// ' / 

tities: the particular curriculum content,™ career education v/as untried; and 

/ * // * /I 

the use of the Texas Telecomputer Grid^and the methodology to be used were also 

_ / * y i 

"^Urikn^wn quantities, although tf]e Grid has been tried for simultaneous seminar or 

workshop methods. • * r '* 

• . • * I 

The report describes the overall objective, plan, 'definitions, and the GHd 

- f ! 

It describes the nature and methodology of the training thafc-nr/as, attempted, and 
the procedure and expectations in using the Grid. It portrays tte eval Ration 
approach and process in this case. The evaluation data and*statistics dre pre- 
sented with their implications. Certain, findings are discusse^and explained, 
and surrmary stateme/itsr are made about the advantages, disadvantages and tfi£ 
findings, Ajj-appendix includes examples of all the instruments employed in 

the evaluation. . • m \ 

* **** * 

It can be summarized that a system like the Telecomputer GHd is useful for 

certain purposes an.d under certain conditions. It has inherent advantages^ and 

disadvantages; orta of the factors that this study does not attempt to evaluate 

is the cost-benefit in comparison to other methods. Because so many states are 

planning various educational technologies and expansions, this report may be of 

significance to all those contemplating various audiovisual methodologies. 



PREFACE 



In September 1974 the Iducational Development Corporation submitted a 
successful proposal* for a third party evaluation of Project INTERACT, an 
innovative and somewhat experimental -effort to present teacher inservice 
training in .a relatively im^niliar subject via the Texas Telecomputer Grid* 
Funds for such an evaluation were very limited, 'but by concenjTcifin^ on 
design and analysis of instruments and requesting TEA assistance in many as- 
pects of the work, this organization felt that a useful evaluation study was 
possible. 

+ * 
Dne particular concern, shared by project personnel and evaluators, 

was that ttie information gained from the various evaluative approaches shoul 

t>e made available as the work progressed, thus insuring that this material 

v/ould have u formative" impact rather than remain a "summative" judgment. In 

order to accomplish this, several infdimal conferences were held throughout, 

and it is felt that these were of value to all parties, 

"The cooperation and support of Martha Westi?rook and John Etheredge were 

freely given and are gratefully arcknowl edged ♦ In addition, the evaluati L de- 

* * j 

.sign required the active participation of many busy people teachers, admin- 
istrators, and TEA personnel. To .all v/ho helped in this, effort, and most 
especial l^J^_th^ Advisory Panel members, v/ho ga,ye generously of their time and 
expertise, the Educational Development Corpoyfftipn v/ould' like to express sincere 
appreciation. * ' c • '* 
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I. INTRODUCTION 

'•. ' ■ ( 

General 




ihis report comprises a third/party evaluation of Project INTERACT, 
an experimental project invol ving /the presentation Df career education ^ , 
inservice programs to elementary school teachers by means of the Texas 
Telecomputer Grid, which is a telecommunications network. The evaluation has 
two m&in thrusts: evaluation of the career education content material, and 4 
evaluation of the use of the Telecomputer Grid as a technology for deTivery 
of teacher inservice programs* 
Objectives ^ 

Mc^re specifically, the evaluation was intended to afldress four separate % 
dimensions of th'e entire project: 

(1) the* programming and the content; 

\ r 

(2) the teacher responses to the programming; ,f 

('3) the indirect influence of the program upon the students % and 
(4) the telecdmriiuni cations medium. 




SeveraTso^thodologies were used and several opportunities, taken" to 
address th.e variou^5b^ctives and. to obtain data and formpfate opinions 
about their outcomes. Thes<T>hl^ be described iff appropriate sections of the 
report* 

Definition s . 
\ ^Generally, this report uses technological and educatioiial^vocabulary in 
aiiormal, everyday context* However, two phrases are used throughout which 
might require explanation, or definition, as follows: 

. (1) "Duplex television 11 or "duplex TU''~ the Jelecomputer Grid has the 
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capability of -using two separate video channels simultaneously* The arrange- 

< 1 - 

ment of equipment and circuitry is sJch that the pictures , from the .television 

camera at*the studio where. the program originates are presented on receivers 
at several locations at the same time. Each of these locations has several 
teachers v/atching the monitor. 3i/mjTtaneously, cameras ^at each location are 
capturing the audiences; these pictures are sent back on the circuitry and 
are available on monitors at other locations, as well as at the studio itself. 
Itjis not possible for several locations^ to be shov/n at the same fime in any 
one location; only two monitors can function per location and usually those 
show the program broadcast and the picture from their own cafrera.* By astute m 
control of the mixer panel at the main studio location, the substations 
can be switched during the interactive period and those on the network can 
all seo^either the broadcast or another substation with which they are inter- 
acting, in addition -to themselves. 

(2) "Interaction 11 occurring on this network can be defrned* as the use . 
of cameras at all locations in such a way that teachers at one location may- 
communicate with teachers at another location, or with the program director,* 
They can see and hear each* other, ask questions, explain viewpoints, and inter- 
act a's specifically as they would if they were in the same room* Thi^ requires 
extremely agile and flexible control. Jfc-, 
Program PI an * /• 

The methodology for the program v/as to organize ti^eati re Spectrum of - 

career education so that it could be presented as an overview and inservice 

• i* * 

training to elementary teachers in eight one-hour sessions. The sessions were, 
scheduled approximately two \/e^ks apqrt, 'about the same time on the sairaNday 

' f % 



of the vieek, and with alV,but one .program. originating from the network head-, - 

.quarters' at "KITteen, Texas, In ,all case?, at least 30 minutes and sometimes 

as nmch as ; an hour was taken up hy program origination from* the control point. 

In the earlier programs; several minutes in the* second.half hour were set* 

a asTde for interaction between the program director and one or more of the network 
* * • * • j - «■ 

• ** ■ * * * * y ■» 

• stations. As the teachers got more used to. this type of interaction and as 

the programs picked up speed and efficiency, the interaction became more spon- 

taneous and less scheduled. The eight sessions were designed to give £ gen- 

eral overview of the entire field of career education and to employ several 

presentation methodologies,,' in order "to maximize, the impact of different types 

of presentation. 

. An advisory panel was formed comprising members of the Texas Education 
Agency .and outside persons* with competencies either in career education or 
in the use of television. This advisory panel met four times; each t'ime it 
viewed video tapes of two of the programs *and evaluated them by means of 
questionnaire forms. . The .findings Opinions of the adyisory panel are 
included in the overall findings of . the ^report. In addition, the teachers par- 
ticipating in* the program, numbering some 85, as well as th$ facilitators, 4 # 
program directors, and others involved* were given forms to fill out prior to 
the programs to provide input data, questionnaires completed during the programs 
to provide process* data, and, a final torni to complete* after the project to pro--* 
vide output , data. These findings are also included in' the overall report. 
(A complete list of Advisory Panel members will be found in Appendix 00 
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II. DESCRIPTION OF THE TRAINJM 




The Network * • ' * / 

The fexas lelecomputer Grfd, a te I ecormfni cations network with several 
.capabilities, fs'ope-rgted by. Central Texas College in Killeeri, Texas and has. 
" * its main studios there. A map showing the layout of f the network comprises 
* i Figure 1. For the full distance of this networ^, tXi& channels of television*, > 
six channeTs of data transmission, apd four channels of audio communication . 
are ayailab/le. , . ' ■ 

The main originating studios, as indicated, are at Killeen, Texas, where 
master control and other switching facilities are available* , Here, engineering 
the camera work 5 and other studio work are performed by students of the college 
who are engaged in learning the fundamentals of television operation/ 

In Dallas, the facility- is at Skyline High School, where fairly good 
equipment is available., along with reasonably competent students to operate 
it. This location has color cameras and the work here i? dbne rather well. 

, At Fort Worth, the X facilfty is .located at Southwest High School where J 
the equipment is quite ,old and worri-oat and the students who operate it are 
somewhat less well -trained than those in other locations. This caused some r 
problems in that usually the interaction from that location could not be 
carried out as expertly nor viewed as well, as that from other locations. 

Thef'facjlity in San Antonio was not in operation {luring this ^ntire 
project/, although it was scheduled to be. Nonetheless, San Antonio teachers 
participated in the program to the tjpst of their ability by assembling once 

every two'weeks, as .'the other groups did, except that in, their case it was a 

i , * 

v/eek later and they viewed a video tape ma'de at the time of the transmission, . 
This, of course, excluded any interaction on their part. The facility in Aus- 
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tin was not yet' operational and extension of tfie system toward Houston had 
,not been completed, , V/ t ^ ' 

Thus there was a total/ of four groups of teachers: one at Killeen,* 
where the program originated, which was in the same room with the program 

cast during the brbadpasting; a second in Dallas v/hich was on line all the time; 

* # </ -# , 

ar third in Fort Uorjth' .which was also on line all the time*, and a foilrth in San 
^iitonio v/hich was never on the Tine and therefore ha3 rto interaction./ 
Brief of the. Presen tat ions. ■ • . 4 

/I v * , 

Ea£h of the eight program presentations included an introduction by ♦ 

the program/di rector, John Etheredge, \/ho explained the purpose of the program 

how ; vt .woul d be conducted, what should be. achieved, and how the program related 

;/ . * :* 

tS other topics already covered or yet to be covered., - ? 

• Almost every program provided handouts to the teachers that they could •< 

take home and keep. These handouts included sora rather expensive ancj valuable 

documents pertaining to career education, examples of different career education 

/ » ► , 

training methods, and other materials which the teachers might find useful in 

their classrooms.. Ea.ch program was conducted using a* method ancl tempo some- - 

what different from that of the others. One highlighted demonstration: others 

featured filmctips, lectures,, examples of right and wrong methodologies, and many, 

many other techniques to make points to the teachers and* to explain the reasons ' 

behind various steps in_the career education training. 

ATI the programs provided the opportunity for interaction, sonfe regular- % J 

V scheduled so' that the^ suhstations would kftow exactly when it was time for , 

them to interact and the teachers could then communicate directly with the 

program director of with others in the studio. On. other occasions, the inter- 

action was extemporaneous and the progranrdi rector would call on the substations 

for cpmmervts, ideas /and other expressions of opinion* Sometimes this 'procedure 



would catch substations unexpfectedly, so th # at response's were slow or not- forth- 
coming* On the whole, the programs v/ere conducted* as .originally laid but t ,al- < 
though* as they progressed, lessons v/ere learned and improvements were made.. 

Thus there was' a s.teady gain.,in effectiveness of the techniques and method- 

' - .i . ' J \ 

ology ^useti .ifi the programs,- and John Eth'eredge went to great lengths to maximize 
ppporturvilies for learning and improving as the programs went on. 



. \Al I. DE^&IPTIOft" OF EVALUATION 

;Approa&^ ^^^'*^ - ' * 

Because this project involved so many variables, because more Jthan or\e # t 

problem had to be solved, and because the arrangements and the programming Jiacr 

been gene^STfly uncontro! I ecu* it was rather di fti^^^j^tarmulate an evaluation 

method that v/oi/Td provide the best results, it ^(ppcmy 'decided that' the 

evaluation would rely upon tv/o main inputs and some additional, subsidiary 

information that could be readily obtained. One of the two primary inputs com- 

prised questionnaire forms, prepared on a statistical|basis, that the^participa- 

ting, teachers^ would complete periodically. Their gains in Knowl£cige and changes 

in altitude v/ould reflect the progress of the project. The other main source 

of input v/as established through the^ormation of an Advisory Panel, providing 

local expertise in career education, as .far as the content of the programs was 

concerned, and in television and technology, as far as the methodology was con- 

cerned. This advisory panel would meet periodically, would review video tapes 

)f all the programs, and, if possible*, would witness live programs. It was 

felt that the conclusions and recommendations of the panel would be important * 

in the eventual determination of project Outcome, ' K ; 

In addition to .these two main sources of information, there ware other in- 

puts from interviews with people on the program, and from questionnaires filled 

out by principals of the teachers involved and by other, peripheral teacheVs 

who were able to observe changes in those participating. In' addition, the 

' - * t * 

facilitate^, (those persons who supervised and. arranged each of the teacher^ 

groups. at each location for each program), also completed questionnaires in- 

{Heating their "opinions concqjrning the project. 




Finally, some consideration was given to getting information from parents , 

»*/ ' • ' * 

students , _ and possibly still other sources, but neither time, nor money permitted 

th£%^tf&ces to be tapped, ~ % . 

e— ■ — , v « 

tiorinaire s. The participating teachers prepared an input or pretest- t 

t , * f t , 

type questionnaire which \/as fi.lled out before the first program and^./hich fras 
then r^^and scored by computer. This questiSnnaire is shown as Appendix A. 
After the first two programs, the teachers completed another questionnaire which 
was al :o fed into the computer apd which appears as Appendix B. This is the 
form dated 30 October 1974. ■ ' 1 v 

^ After the fourth program o| the project, the teachers were given a .second , 
process questionnaire, which is -shown' as Appendix C. 

After four more programs, the teachers were given a final process, ques- 
tionnaire, primarily covering the last four programs^ This questionnaire,, 
dated 5 March 1975, comprises Appendix D. ^ 

Finally, the teachers were given an^ overall questionnaire to obtain their 
opinions on and evaluation of the entire course. 'This form is dated 6 I'arch 

and appears as Appendix E, 

t \ 

/These five questionnaires given to participating teachers were all compared 



i 



statistically by computer, and represent the bulk of the findings of thi $ report, 

9 • 

Although other questijonnai res were given to other groups, none of them were 
handled by computer, aftd they comprise a less important segment of the overall 
conclusions. . ' 

The fa^Mitators were present during all of the programs. They were given 

* * 
a pretest questionnaire much the same as that administered to the teachers, 

to obtain similar kinds of advance information. This fora^dated 15 October, 

appears as Appendix F* The facilitators were not given proce/s .questionnaires, 
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but they were given the opportunity to make a finaTTVfcluatioh, not in ques-* . 
tionnaire form,. but through open-e/ided or essay-type questions presented to 
them to .answer as they chose. The letter to the facilitators s^qiting^ % * 
their overall opinions is dated' 7 March and is shown as Appendix G, The ques- 
tionnaire given to other teachers, principals, and members. of the school staffs 
at the beginning of the program. comprise? the form dated 30 October and is attached 
as Appendix H. ' , 1 , 

The questionnaire given to the Advisory Panel to determine their back- 
ground 'and prior knowledge was administered via. a form dated 6 November 1974, 
which appears as Appendix I.. The critique form that the pan^l used to evaftiate . 

the video tapes was used for the first twc>, presentations as it appears in ' ' . 

* * ■ * - * * 

*** * 

Appdndi^ J: .subsequently, it wafc changed to the forms shown in Appendices K and 1? 
thgn used thereafter. The overall, final foirn given to the Advisory Panel a£ 
th§ end of the project 'is dated "25 f larch, and cippe^rs as Appendix M. ' 

. Interviews , Early in the program it was envisioned that interviewing 
the participating teachers at appropriate times and possibly observing them in 
the classroonfwoul d provide useful input to the overall evaluation. As it 
turned out, the teachers barely arrived in time for each of the scheduled 
programs to start. Teachers were quite nervous before the programs started, 
interviews wer^ clearly impossible during the programs, and because much of 
.this project took up the teachers 1 ov/n time, they generally left as soon as the 
programs were over, so that it was not possible to conduct* very productive inter- 
views. A fomi was prepared for interviews nevertheless, and it is shown as * 
'Appendix fi. However, so few interviews were 'conducted and so few, observations 
jnade in this manner that the informat/pn obtained vja this form i$ virtually 

~> .- ■ • 
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.useless. 

v * 

The five £uestix>nn$i/fe forms filled out by participating teachers were 

coded aruf keypunched ana then tabulated by a University of Texas computer*. 

* T * - * ^ / J * » • ' " " ' p * " 

Keypunching of pie coded material was done by staff of the Texas Educatio^;^ 

Agency. The computer/run involved statistical summaries for the •purpose of ' 

obtaining totals and/peccentages* 



As .previously rioted,, fi ridings 'and, comrants from the ^various evaluation 

" " ' r . " ' \ • ' f < 

* instruments wer$ mafle available to those responsible for the Project as it 

[•«%■• . 

• / *.# t ■ ** * 
^ro^ressed. In addfition, suggestions for ^desirable input v/ere received from 

project personnel and from "Advisory Pcinel, members, and these were incorporated 

into subsequent- instruments wheneyer possible. , . * 
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> . ;V. EVALUATION DATA 
As stated previously, the limited financial resources available for this- 
evaluative study dictated a dependence on opinion surveys of the participants 
and generally precluded a, more thorough effort that would involve extensive and 
objective follpw-lip measures in the impacted classrooms. In addfition, the ^ 
desirability of formative in,put suggested occasional changes fff'the instruments 
^n order to gain "immediately useful information, at the expense of strict com- 
paratfility of results. For these reasons, and because of the inherent un- 
reliability of questionnaires completed under uncontrolled conditions, the anal- 
ysis of the resultsHs limited to number ancf percentage comparisons, v/here pos- 

s. 

sible, and generally to simple statements of fairly obvious preferences. 

The input from the -Advisory Panel v/as quite complex, and members of thjs 
group steadfastly resisted aqy attempt to force choices on them. For this rea- 
f ^ son, the main findings from their opinion questionnaires involve their responses 
i . to jth^open-ended questions, v/here they answered most freely and helpfully. 
Though material of this sort has important impact, it is more amenable to treat- 
ment in terms of narrative discussion than in terms of statistical analysis. 
v % - * 

Some data from their questionnaires are .inclurded in this section, but most of 
* « * 

their consents are summarized in the following sections of the report. Actually, 
^tince the -participating teachers also responded to open-ended questions, some of 
their valuable insights are -also covered more in later sections than in this one, 
1 . Participating Teacher Questionnaires. 

s 

The first .(October 16th) questionnaire contained questions that were in- 
' tended to describe- the sample. In addition, a brief "pretest" consisting of 
questions abaut information in the field of career education was included. The 
extremely tight time schedule made it impossible to develop a pretest dealing 



specifically with material to be presented in the classes; therefore, some items ^ 

from an alveary-existing test in this area were selected, with the permission 

of its. developer, pr f Walter Stenning of Texas A and M University, 

A. Questionnaire, of 16 October, 1974 " v "3 

.(Not all respondents answered all questions.) 

Age: Range 22 - 63); M = 38. rs^"' '•' 

Sex: 72 Female;- 6 Ltale. v - .'Vv* ; 

Highest Degree:- 47;B,A. ; 31 M.A. ' <^-*\ , 

Grade Taughtt 'k - 4} 1 - 11 ; 2 - 5; 3 - 8; 4 - 13; 5 - tl \% - & 

* * - 

Area of Specialization-: Elementary Education, most frequent;^- -~ 

Language Arts, sscond; ^ ^ 

Art and Counseling; third. X / 



Years .in this school: Range 1 - 20; M = 5,50. * 

Years in this system: Range 1 29; H = 9,03- v , 

Ye^rs teaching: ] - 36; 11 =12,28. / i 

Career Education Training: 24 yes; 54 no, v " 

Formal courses: 3ange 0-8. /• » ^ 

Workshops or short courses: 'Range 1-3, i" 

Kead books or articles about career education: 5i yes; *26 no. } 

Inservice training in any field:' 33 yes; 43 no. 

Experience with -educational TV: *7 yes; 49 no.. 

Experience with duplex TV: 1 yes {Hedical-Dental training). • • 

Use of career education curriculum materials: 29 yes; 49' no; ' * - * 

Career education taught in your school: 42 yes; 36 no. # > 

I as a separate class; . - 'L 

27 as a part of several subject areas; t ^ 
23 as the -teacher feels it is needed* >. 

-M 

Involvement 1n career education: classroom teacher* Interested but no special^ 

training, most frequent; /?" 
specific training or experience, second; > 
faculty representative for this program, thirct 

> . - f 
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The most frequently mentioned. as hoped-for gains from participation in 
the project were, first, to learn methods of teaching others about. career ed- 
ucation; second, to gain a better understanding of career education; and third, 
to get ideas about activities and materials for classroom use. The results 
of the pretest wall be discussed in comparison with the post-test, administered 
with the'March 5th questionnaire (see below). 

■ > r 

B. Questionnaire of 30 October, 1974 

(Administered after the first two INTERACT programs - not all respondents 

answered all questions.) 

Enjoyed participation: 66 yes; 1 no, 

ffsked questions or made comments "on the air": 18 yes; 45 no. 

Will use materials or information in classroom: 62 yes; 9 no. % 

' 0 

Found the technical equipment: 

' -working well all the tine, J?;, 
-mostly satisfactory, ' 
-having many problems, 6; 
-highly disappointing, 4. 

Found the material presented: 

'-helpful, 62; -new, 15; 

-not relevant, 3; -familiar. 21; 

-njostly useless, 2; -old, 3. >. 

Found £he format and physical arrangements: , - 

-comfortable, 30; < % *. 

-acceptable; 38; 
-clumsy, 3; 

-discouraging to interaction; 1. 

A comparison of the duplex TV technique with other types of inservice training: 
-Workshops better. 14; same,, 18; duplex TV better, 29; 
-Training films better, 8; sane, 13; duplex TV better, 39; 
-Tape-slide or filmstrips better, 4; same, 1; duplex TV better, 48 .< 

* 

Statement concerning present opinion* of this training: 
-needs to improve, 7; ■ 
-really great so far. 37;; 
-material fine ? technique a problem, 14; 
5 -mostly ? waste of tins, '6 ; 

-technique interesting, subject matter so-so, 3; , 
- -firobably the best they could do, 1, 



Single mos^ useful thing* learned: 

-possibility and importance of teaching career education at any level* 
most frequent; - ' 
-becoming acquainted with career education, second; 
-importance of 5 career awareness at an early age, third; 
-Ijow to* conmunicate, , relate, and interact, fourth, * 

Single most obvious fault or shortcoming: ' • f . 

-inadequacy of equipment, leading to distraction and breakdown of interrotio 

most frequent; * J \ 

-uncomfortable setting (too hot), second (mostly from the studio in Killeen}] 



•participation and interaction less than expected, third;' 
•lack of appropriate/level materials, 'fourth. 



Suggestion for improvement: . • * 

-more- involvement and/or interaction /most frequent; 
-more dependable equipment, second; ' 
-more infprmation and material to share andlise, third, 

C. Questionnaire \f 10 December 1974 

{Hot all respondents ansv/ered all questions.) 

Thi§ instrument differed from the others and v/as mostly for the specific 

purposg of comparing the third and fourth programs with the first two. Thus 

it* does not fit into the total design, but js of formative interest in as- 

* * •> ■ 

certaining the differential acceptance of two monies of presentation, one con- 

centrating the interaction in the second half of the program and stressing 

information (Programs 1 and 2), and the other featuring continuous interaction 

and stressing demonstration (Programs 3 'and 4), 

Preference:* 

-Programs 3 and 4, 44; 

-Programs 1 and 2, 0; 
_ -Equarl ,18. * ~ , 



Saiis faction v/ith interactions 
VPrograms 3 and 4 better, 45; 
-Programs 1 and 2 satisfactory, 2; 



i|p real preference, 13. \ 



\ 

Materials packets: 
. -complete, 20; 
-useful , 41 ; 
-incomplete, 0; 



-mainly good as a resource, 26; v • * ^ 
-not relevant to my- classroom needs, 5; 
-stale or. over-used, 1; 
-require unavailable material, 2, 

, / 

Difficulty in finding appropriate activities: for your grade? yes, 6; no, 53 

\ 

Opinion of project so far: ' - 

-effective, 34; 
■jtoo hurried, 8i 
-confusing, 9; 

-no interaction so far, technical problems, 15. ' - 

Passing microphone around is: 

-too troublesome, 0; \ 
-distracting, 8; 
-not too bad, 31; 
rinteresting, 6. 

Talking on camera is: 

-frightening, 3; 1 
-inhibiting, 4; 

-fun, 10; * 
-getting "easier, 29; 

-haven't done it, 3. ~ * 

I would like more interaction: yes, 34; no-, 10. 

I am more interested in speaking with: 
-the presenters, 22: 

-teachers at othe'i? sites, 20. . 

Compared to workshops j tfie arount^of interaction was: more, 24; less, 8J . 
the same, 12. 

The one-hour period was ^ 
-a£out right, 41 ; 

-too rushed, 5; • 

-crowded with too much material, 1; ' ^ 

-too long, 2 . 

What v/ill you be looking for* in future programs? 

-rrtore useful grade-appropriate materials and activities, most frequent; 
; -more interaction and participation, second; 

-more specific information about career education, third. 

What would you change about the programs? 

-accent materials and activities (like .numbers 3 aau 4}, most frequent; 
-more time to complete projects and ask questions, second; 
-accent interaction and sharing, third. 
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D. ,Questionnaire*of & March 1975 ' . % 

The brief first portion of this questionnaire requested reactions only 
to the last four INTERACT programs . The second portioh comprised the "post- 
test" previously referred to, ({Jot ail respondents answered all questions/), 

The ^materia* presented was: 

-helpful, 62; ' * ' " -new, 21 ; 

-OK 5. but not relevant, 2\ -familiar, ]7; 

-mostly useless, 3;. • -old, 3,* 

Would you use anything shown in these programs, in youV classrooms? * • 

yes, 69; .no, 4. ' - , / \ m • 

- ' The fo'n^it and physical arrangements: : : ' ' 

•\ -comfortable," 29; - " , • 

, -acceptable, 38: y 
, ' -clumsy or distracting, jj; , • ' 

-discouraging to interaction, 6. f 

The .single most useful thing learned: * ■ r> 

VobjectiVes oT career education, career awareness, most frequent; 
-classroom techniques,, activities, interesting the students, second; 
, -variety of different resources, new ideas, third* 

The most obvious fault or^hortcoming: 



-technical problems, '^ise, npst frequent; 
-inconvenience of place and £i me, "rushing" . 
-lack of continuity, third* \ 



second; 

Results from the pre r and* post- testj can be summarized as follows: 

' % Pre- test < Post-test 

Mean 4 10.1 , 11.0 

' Median ' 10.07 11.35 - • • . ■ 

Mode * 10. * 12. 

Starfdard Deviation 1.554 ' 1.592 
" t. 

'The difference between the roans is significant beyond the ,01 level of con- 

* > ■ 

fidence (t = 3.38K The difference between the rredians, which is a more ap-. 

propriate measure of central tendency because of the skewness of the post- test 
distribution, is even more significant (t'= 12.00). The indication is that the 
teachers learned general inft^matiori about career education that was not spe- 
cifically part of the curriculum, and thus that this was* an effective teaching 
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. E. Questionnaire of 6 March 1975 '• ■ 

• * fi 

(Not all respondents answered all questions.) 

t . This' was an instrument designed to provide an overview and summation of 

, * - P\ 

the project's impact on the participating teachers. - . l \ 

Number of prognams attended: k ' 

> 8> - 26 ' . . - f , ' 

7 - .11 (Many respondents left . ' ' < ' 

4 6-9 thfs blank,) * ' „ N * , 

5-5 • . . " ; A • . 1 



r 



Enjoyed the. experience: yes, 53; no, 3, 



The technical equipment: * , n 

-worked well eill the time, 3;* * 
-was mostly satisfactory, 18; r • , * ** « 

-had a la/ge number of problems, 23; - 4 ^ 
-was - highly disappointing, 13, , A . 



? 1 • 



Did you personally ask questions or make corrodents "on the air"? yes, 38: no, 14. 

* 

Comparison with other inservice training methods: • 
-Workshops better, 22; same, 16; duplex TV better, 14; ( 

* -Training films better, 11; sarne/?6; duplex TV better, 24; 
-Tape-slide or filmstrips better, 9; same, 11; duplex JV- better* 30. 

Opinion of the training experience: * ■ 

-needs to improve, 8'; 
-was really great, 9; ' 
. -material, fine, but technique a problem", 32? - 

-mostly a waste of time, 3; • - : 

-technique interesting, subject matter so-so, 4; ' ' ' * , 

* -probably the best they could do, 1. * i 

The* materials packets were: * r ' 

-complete, 19; *. ^ ^ . 

-useful,' 38; f 
-incomplete, 0; 

-mainly gaod as a resource, 26; * 
-not very helpful , 1 ; 
? -mostly" a waste, 1 ; 1 

-not really nec^ss^n^, 0. . 
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Ihe activities demonstrated were:' „ 

-useful , 47; ' * - ; ♦ 

-not clearly presented, 2; . 

-too simplistic, 3; % ' *. 

-not relevant to my classroom needs, Iflj*' 
-stale or ,over-used, 2; . ; . " • - p 

* -require unavailable materials; 3«,,-; * ^ - 

Was it difficult to find .appropriate materfal\for the grade level of your class? 
yes* 44; no, 9. i.\*V \ ' * 



The TV interaction was;: > r 
-effective, 23 ;\ ' 
-t6o hurried, 10'; ~ , 
• .-confusing/ T2 ; « 
-not possible or available, IO4 
-ineffective, non-essential, 4/ 

Passing the microphone around ws: 

^^ A trpublesome,*7; • 9 

* <' -distracting, 16; 
-n^t too bad; 4 *20.; I 
-npt available, neterusgd, $. • V V 

<> 

Talking on camera was: * - j 

-frightfepin*), 2; 
-inhi@|ing, 5; 
-fun,|#; 

s -gettrtig easier, 16; \ • ' 

-inJ^uftrrU 9i , 

I would have liked more .interaction: yes, 40; no, 10. 

I was mo re / interested in speaking v/ith: . 
-the ^presenters, 23; - 
-teachers at other sites, 28* 

Coinparecr to Workshops, the amount of interaction was: 
-more, ]1 
-less, 20^v 
-the same, 15, 

The one-h'our periock v/as: 
-aboift-rigfit, M 
' -too rushed^ 7; 
-crowded with too\much materia-r, 4; 
-too long, 4. 
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Did participation fulfill the hopes you had for it? 

-yes, 17; - * 
-no, 10; . • , 

-partly, 27. . ; » x • * * 

What would you change ^or do differently? ' v 

-better planning and cobVcflnatiQrv, most, frequent; 
-more direct feedback from participants and more participation from ■ 
teachers, second j - ' 
-better location snd better technical set-up, third. 

What aspect, of the. programs would you particularly praise? 
.-books and materials, most frequent; 
' * -prganization and "fun 11 of programs, secohd;. • , " • 

-John Etheredge. and* presenters, third* % 

What aspect of the program would you particularly criticize? ? 
-duplex TV technical problems, rdbst frequent; 
- -lack of continuity, second (only 3 respondents), j .\ 

The facilitator was: 

-a real help, 33; -not much help* 4; 

-essential to the project, 22; * -not that' necessary , 6; -* 
-too bossy, Oi. , 1 -not enough of a leader, 2. 

> 

I recommend that this kind of inservice training be: ✓ 

-developed further, 45; I' • j 

-droppecf, 8; w j 

-used in its present foftn, 1. % . j 

Additional comments: - . 1 I 

-informative and interesting experience, most frequent (3t$$ * * 

-technical problems made evaluation difficult— it needs much work, second (15) 
(no other* comments made by more than 2 participants). , / > j * • ] 

Summary of Teacher Questionnaire Findings - ' , J 



Though these teachers became somewhat disillusioned about the technique as 
the programs proceeded, they generally felt increasingly comfortable .in the 
situation and felt positive about the experience. They valued the idea of irvter- 
action and v/ere disappointed when it didn't work as well as they hope^l. r They ' 
were looking for both background and skills in career education, and they were 
pleased v/ith the materials and the lessons. Workshops are evidently preferred 



over all other irrservice training methods, but, in sprte of the technical in- 
adequacy otf duplex TV at«this time, they placed it second in preference - highe 
than training films, tape-sVide presentations, or filmstrips. , 
+Z\ Advisory Pa n el Checkl i st' - Critiques ' * , 

,As pointed out iri the introduction to thi$, section, the main evaluative 



material gained from the Advisory Panel members v/as found in .their comments 

and response^ to open-ended questions,' However, they faithfully tilled out 

the requested checklists, and there are some objective data from these* As 

a gene PSV rule, the Advisory Panel members were jnuch more critical ,than the pan 

ticipants, y/hich is natural, since, they were selected as. experts in either ed- 

ucation and training or television and communi cation technology* >, 

- A, Concerning the Technical Aspec t's 

7" ^ , 

^rom tlje hrsi segment viewed. by the panel, there was criticisjn of the 
technical functioning, though in the early .program .critiques the' comments con- 
centrated on specific faults, such as poor camera movement and clumsy and 
dis jointed /nixing. This had improved somewhat m.the third and fourth seg- 
ments, where switching locations was seen as the greatest problem. Problems 
with technical dependability began troubling the panel in Program 6, stince 
efforts to interact with Ft/Horth and Dallas seej?ed"very slow and distracting. 
By the sixth program, the Adviso^Panel members were really questioning the 
technical feasibility of tKe^coRcTSpt- Ihfe seventh and eighth programs did 
not reassure them, and their ^fma^evaluati on ^of the technique was quite 'pes.- 
.simistic. - ^ * \ - ' • . i * 

t . Bbth panel members and^tjprs v invited to comment pointed out that tech 7 - 
nic£l innovations are often^jK% and discouraging in their first appearances. 



However, at least some of 4 the disillusionment expressed by Advisory Panel par- 
tici pants involves the general deterioration in techijical quality toward the + 
end of the project. , There were always reasons for the noticeable lapses, su^n 
as* atmospheric conditions, the Christmas holiday break, and the use of sjttrtfent 
trainees technicians,, but expTanations. really didn't help to dispel the 
disappointment f t el t t by the 'panel. 

B. Concerning the Subject Matter Presentations 

The major criticisms expressed by the Advisory Panel involved stereo-* 
typing, -superficial and unrealistic presentation of career education, and oc- 
casional pointless activity. Panel members generally appreciated John Etfteredge's 
vulnerability during the programs, and there wasy considerable praise for his per-, 
spnjal qualities. Tl?§ "awareness" aspects of the presentation were particular- 
• ly approved, but the very elementary level of some of the activities presented 

^ * was .noted. ' In their final summaiy, .mojt panel participants felt mostly -positive 

* '* * * 

ab6ut the program "content, though they pointed 'out that the technical failures 

made it nearly impossible to get an accurate picture of the program impact, 

3. Non-Participating Teacher Questionnaire 

4 sample of non-participating teachers from the same school districts as 

" * *• ~ ■ » 

we're represented rf in t)ie project kindly consented, to take the brief pretest. 
This group can be considered as providing base-line data to check the project 
- ' pretest statistics. -The 'mean score of this sample of 109 teachers was 9.91, 
while 'the median v/#s 10.28"-. 
* . These scores do not'differ significantly from the pretest mean and median 
k for the project sample, indicating^at j$\e participating teachers were com- 

i*< parable before project INTERACT, with other teachers in terms of general back- 

O ' ' . - ' * • • 23 - v " 



ground knowledge of careeV education. Financial limitations made it impos- 
sible to re-test the non-participant group;* 

4.« Data from the Facilitators and Others Identified with Project INTERACT , 
Career Education, or 'the Tel ecomputer -Grid , • • 

< 

The project facilitators and their alternates were asked to comment on the 

> 

project, as were * number of others who had close ties with some aspect of 

INTERACT, career education, or the Telecomputer Grid. The documents re- 

» f* * 

ceived were thoughtful, balanced, and most helpful, 4 

Their overall .reaction was generally. positive, mirroring that of other par- 
tici pants. Tjjey saw considerable potential value in use of the Grid as a re- 
source for education, and they tended to take a* broad view, encompassing a' 
pumber of possible applications of this technology rather than inservice train-' 
ing alone. Like the Advisory Panel, they were critical of the present status o 
Grid maintenance, yet, on the whole, they concentrated .on what could be done 
if the technical difficulties were overcome. They were realistic enough to 
view the project as very expensive inservice training, but they were future- 
oriented Hiough to mention that innovation is often not cost-effective in early 

^applications. ^ \\ 9 

% ■ 

They suggested that any future effort of this nature start earlier in pre- 

< 

paration and orientation. They also questioned the v^lue of the interaction 
with large groups, feeling that the duplex TV technique is most effective for 

J « > 

small-conference-size classes. There was a suggestion that duplex TU needs * 

j * • ' M' 1 

, central coordination,, -preferably by a specifically responsible TEA staff. 

Local evaluations were evidently carried out by'facil i.tators and other re- 



' 0 



sponsible school personnel. These evaluations, as outlined "in the summaries, 

. " 23 



< » ' * 

generally support the data presented in this report, with generally positive re- 
sponses regarding program effectiveness and many fcoticems expressed about ^ 
technical jreadiness of the system, 
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...... V. DISCUSSION OF FINDINGS r 

• * 

About the Telecomputer Grid * 
v There is little question but that the Telecomputer Grid was not ready 
for thjs project at its inception, nor was it ready at the completion of the 
eight lessons/ The Grid does not operate full time and is, in fact, closed^ 
down a^'goDd part of the time, so that for each program* or presentation of 
this project" quite a bit of work was neaessary to mov^ the system toward peak * 

r 

efficiency. On several occasions tliis was not carried out satisfactorily and 
'technical failures occurred during the presentation. Further, \he system is 

• • L 

< S * 

comprised of Some new .and some old equipment, some expensive and some cheap, 
apd it, is operated by students who are just learning the skills of television ' 
production and cannot cope with alV the problems as they occur. The Grid; 
willonever function efficiently or effectively until it is operated full tine 
by fully qualified\persons. However/ it cannot reach this level of excellence 
until it finds enough clients to lease circuitry to warrant its staying on 
the air full time, and it. cannot obtain enough clients until *it can demonstrate 
' a higher level of performance J Thus, a vicious cycle exists .in v/hich the net- 
work cannot perform well without clients and the clients will^not core in until 
they' see that ♦the network ..can/ perform well . 

The Texas. Education Agency, has been supporting the Telecomputer Grid for 
the past* few year$ indifferent ways: through money for the purchase and in- 
-stallation of equipment, through tryout of various methodologies, and possibly 

through other means of assistance as well. Actual input is mt known, but 

* C * ' * * 

the total fundirtg for the operation of the Grid has not yet reached "critical 

mass." That .is to say, until and unless the network is brought up to profession 

al standards and kept/in that condition (by professional standards v/e mean the 
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levels of performance with regard to equipment, personnel, maintenance, and 

repair that would he expected of commercial TV broadcasters > carriers such as 

AT&T , etc.), possible clients are going to view the working of the system as un- 

satisfactory. This means that continuing to provide sjr^ll amounts of funding will 
• • • ^ 

result in continuing ^disappointment, because although one problem may be 
solved, others will be discovered or will suddenly develop. Only sufficient 
bootstrap funding support can get the system into satisfactory shape. 

Counteracting tJohn Etheredge's high dedication, good organization, and 
effective programs was the fact that the Telecomputer Grid itself operated very 
Jnefficiently and encountered fluent failures during the course of these 
programs. Sometimes the failures were video, sometimes audio, and sometimes 
both; often the cameramen were nat doing a xjood job (zooming when they should 
h*ve been fading", switching to the wrong camera at the wrong time, or cutting 
away from people in the middle of a sentence); and there v/ere many other problems 
caused by the generally poor equipment and the inexperience of the operating 
crew. Many times during ,the course of the programs the microwave links failed 
or malfunctioned, prqbably- because of atmospherics. This prevented interaction 
or communication between sites at times when it should have taken place. Thus, 
the conclusions o'f most of the participating teachers and of the Advisory Panel 
are that this process of interaction by two-way television might possibly be 
successful ff everything worked well, although they felt uncertain that* even 
with everything working well, the results of the program and the interaction 

would have been as. beneficial as originally hoped. 

< 

About the Program Content 

John Etheredge had originally decided not to follow the usual pattern for 
presentation of career education, but to design his o\/n, with two major con- 



siderations. The first was that^ career education is not a separate subject, 
but one which needs to be highlighted frequently during the -teaching of other 
subjects; this requires good organization and broad career education aware- 1 
ness and knowledge. The second consideration was that the Telecomputer Grid made 
use of, a technology that was not normally .avai] able, and rather unusual tech- 
niques and sequences were required for maximum impact. As a result, no two^ 
Of the-eight programs ,in the project followed the sane pattern of organization 
and presentation or the same sequence of ^techniques. Each program had a dif- 
ferent structure and was designed to produce a different and measurable impact , 
on distant audiences. Each was also designed to maximize what had been ob- 
served and learned, in the previous programs. Thus, the eight programs could 
not be laid out far in advance, although they were sketchily designed in ad- 
vance, but the later programs were. reorganized and adapted to correct previous 
mistakes. It must be remembered that these programs were presented lfve, withf 
no prior videqtaping. (This does not include material whiqh was clipped from 
other films and presented as part of a live program.) • There is no question 

about the extreme dedication of Etheredge and his attention to details in or-, 

# 

gamzmg and presenting the programs. He travelled to all sites between programs 
to discuss them, to get suggestions for improvement from facilitators and teach- 
ers, and to develpp further interest in the programs. 

This methodology does not permit very much individualization of instruc- 
tion, although the bocrtcs, pamphlets, guides, manuals, and reading materials that 
w6re given out at most programs could be read by teachers on thefr own, Jt 
must be realized that this technique basically provides mass, one-way instruction, 
although here there was some opportunity tor interaction.' • For this interaction 
to occur, however, some 80 to 90 teachers. in four different locations all had 

■ X 

* • 

: 28 * 



to be at an appointed place at a given tme. Whether or not they felt well, 

f 

whether or not it was raining, and whether or not they could find a parking 

place, /they still had to-be in the room at the time the program "started and had 

to stay there for exactly one hour. There was no opportunity for make-up if 

they missed a program or lesson. The conclusion that must be reached here is 

*that such a methodology has only very limited flexibility, and does not con- 

s^rrfjer individual tastes:, choices, or preferences as to methods of learning. In 

short, it is an enforced methodology to which participants must make their 

contributions at precisely the right time* It should be noted, however, that 

workshops, which were evidently the participating teachers 1 preferred method of 

jnservice training, share some of these drawbacks, ■ ^ 

About the Organization and Presentation 

There is no question but that John Etheredge's enthusiasm, dedication, 

i 

and excellent performance are major factors responsible for the program's gen-" 
erating interest and obtaining good results. Further, without visits between 
programs, without someone making continuous efforts to generate interest and 
improve the programs, the outcomes might have been less positive^ 

In a project like this, one must consider the possibility of the Hawthorne 
Effect* operating throughout, as a resuljt of the general excitement and enthu- 



* Experiments were conducted in the Hawthprne Works of the* Western Electric 
Company (Chicago) from 1927-1932 to determine factors influencing the workers 1 
performance, motivation, attitudes, loyalty, etc, After several years of 
statistical and behavioral study, the experimenters finally realized that a 
*small group selected for any kind of experiment or for whatever reason exper- 
ienced an uplift of morale and attitude and an* improvement in performance just 
as a result of having been selected, and regardless of any other factors. This 
phenomenon has come to be called the "Hawthorne 'Effect*" 
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siasm generated, Thisfis not necessarily bad, nor does it necessarily lead to 
erroneous conclusions, for if the programs were presented again and the Tele- 
computer Grid , used again, then the Hawthorne Effect might again produce sig- 
nificant and encouraging results. However, when a program or project is pre- 
sented on a routine, operational basis, then- the Hawthorne Effect is likely to 
be lost. 
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VI • SWWARY. STATEMENTS 
Sunrnary of Advantages m 

? 0nJ£e t>asis of the above discussions and the consensus of the teachers % 
and^Advisory Panel, the following possible advantages are indicated: 
* j (1) The Telecomputer Grid offers the opportunity to reach ^groups of people 

I** * m 

in several locations simultaneously, on short notice, to fh^vide Information 
and to obtain comments and reactions; 

(2) Use of the Grid presents an opportunity to reduce trav£\ -requirements 
for eTniEiiber of people; . 

(3) The Grid permits interaction and discussion betv/een groups, \hu£ pro- 
viding the opportunity for venting of opinions and emotions; 

(4) A variety of techniques can, be used to convey information, as ori\ 
commercial television; 

(5) There is an opportQnity for several kinds of group conferencing: ) 
formal lectures, open discussion sem^ars, and very informal brain-stonning; 

(6) In many ways, the Grid can (potentially) duplicate the advantages of 
workshops, especially in making the expertise or special skills of certain in- 
dividual s'widely available, and" at some savings in time and, perhaps, money 
(e # g, , "master teachers," popular and expensive lecturers, etc.). 

Summary of Disadvantages, > 

It is always easier ftfr anyone to be critical than to be commendatory', 
and v/e are no exception to the rule* However, the following sianmary represents 
the consensus of others, and not merely our own opinion t although we also viewed- 
the taped programs and feel that these findings are accurate. 

(1) The entire network needs to be "debugged," then kept in top operating 
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condition. There is a serious question as to v/hether the equipment and personnel 
nowon hand can actually attain satisfactory levels of performance, since al- 
most the entire network is operated and maintained by students, who lack the 
maturity and experience to ensure satisfactory opej^tion; 

(2) Although specific dollar figures have not^een obtained #nd costs' cal- 
culated have been omitted from this evaluation, it nevertheless seems to be 
evident that the- cost per student hour of a system like the Telecomputer Grid is 
far higher than that of most of the other instructional methods available; 

(3) A system of this nature lacks certain types of flexibility. Where- 
as delivery of the content can be quite flexible, demands on the audience afe 
yery rigid. Time, place, appearance, and subject are all beyond the participant's 
choosing; the entire audience, in all locations, moves in lock-step; 

(4) Any interactive system such as this one lacks individualization of in- 
struction. Considering that the trend in teaching children is more and more 
toward personalized diagnostics, scheduling, and measurement, it would s£em 
logical to use this met^pdology increasingly rather than decreasingly in teacher 
education; 

(5) Similarly, instructing separate' groups , as in this project, is hin- 
dered by the fact that each group will have a different level of both knowledge 
and interest. Thus, such instruction can only aim at the mid-point, or average, 
of the groups, and in so doing it runs the risk of missing all of them; 

(6) Once commissioned, a network such as this one might become a perennial 
millstone— "ft costs money whether used or not. Hence, the compulsion to use it 
w to get the money 1 $ worth" arises, and it is used whether such, use is actually 
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advantageous or not. • 

The statement of these disadvantages seems father severe and ruthless; it 
is, not so, intended. It is, however, best to be frank, and even somewhat extra- 
* polative, rather than to "brush anything under the, rug. u * 
Findings 

In the light of all the foregoing facts, opinions, computations, interviews 

L 

and observations, the following findings emerge:^ ^ ^ - 

As to the Telecomputer Grid— 

1 m (1) The Grid is not operating well for duplex television, and it is 

doubtful that it can operate satisfactorily without a suffi cient transfusion 

of funds fqr replacement or rehabilitation of equipment and procurement and/or 

* 

training of skilled personnel. 

(2) / The frequent *4nd recurrent failures of the network prevented really 
accurate evaluation of the career education program. ^Not only did some of the 
instruction disappear into an inoperative system, but cumulative frustration 
and annoyance at the system turned into at least some disillusion with the whole 
project, including the content, 

(3) If the Grid continues to be used as a vehicle for student instruction 
in television production, it may never be suitable for professional educational 
use. y * - 

As to the career education content — 

(1) A very large proportion of the teachers felt that they had learned a 
lot about career education, and had gotten many new ideas far classroom use. 

(2) The facilitators, Advisory Panel, and other professionals who observed 
parts of the programs felt, with few exceptions, that the presentations were in- 
teresting, diversified, stimulating and appropriate for inservice training for 

37 

' 33 



elementary teachers, and that, on thoSe rare occasions when' the whole concept 
was working-efficiently, the* experience was quite exciting. 

» * 

(3) Career education concepts and various teacmn^j techniques both re- 
ceived adequate treatment; there was no material of either kind that could not 
be covered well by this medium* 

As to the organization tnd presentation— , % • 

(1) 'John Etheredge did a fine job of organizing the course; developing, 
making, and improving the presentations; and in ^general maximizing the inr' 
structiofial impact. One would have to go far to find the equal of his talent 
and dedication. f J 

(2) . Unfortunately, the frequent non-performance of the Grid undermined much 
of his extensive organizational effort and progranrning talent. It would be 
difficult to 'sky what would have happened if an inservice training effort such 

as this were "routinized" and forced to "go it alone," without constant atten- 
tion and the kind of trouble-shooting Mr. Etheredge had to do. 

Overall— , * , 

(1) There are no objective data concerning the long-term influence of the 
course upon participants or any follow-up activities, although several teachers 
did indicate on their overall evaluation forms that they had started to use 
ideas from the course in their classrooms and intended to continue. . 

(2) The course in career education as presented was successful, in spite 
'of the poor performance of the medium. 

(3) The cost of the course per student hour was possibly prohibitive, and^ 
'this level of cost will continue into the foreseeable future. 

(4.) Except for a few brief and generally unsuccessful interactive inter- 
ludes in the course, all the material presented could have been presented in 
other training formats, and by other media at least equally well, and possibly 

with less expense and confusioru 38 
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(5) The more the lessons resembled workshops (in stressing demonstration 

t and active involvement of participant^), the more positive were .the teacher eval« 

* * 

uations, and there was a strong tendency to val ue the idea of potential inter- 
action; thus, in spite of the poor dependability , record of the Grid,^most 
respondents continued to f6el that /the technique has promise for education. 

(6) Neither the participating teachers nor others who had evaluative in- 
put saw the duplex TV technique as a replacement for any existing^^service^T 
training method; rather, it was generally perceived as' a potential addition to 
the .repertory of avail-able .training resources," assuming consistent technitaj per 

fofmance, of course'. P 

( 
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Appendix A 



EDUCA TIONA L DE VELOPM^T CORPORA TION 
2813'RIO GRANDE ' T j& '" • ; ' / " 
AUSTIN, TEXAS 78705 

. ----- - c . 



(512)476-6868 
* 476-541% ' 

* 

Dear Teacher: 



16 October^l974 



Project INTERACT * is a nqvr venture ia educational use of tele- 
Vision technology, and .^Iconsiderable amount of . evaluation 
will be necessdry in ordetp-tQ get maximum benefit from this 
innovative 4 ef fort. We really need your help in' every phase 
of the project, and we JknoV Y ou will understand that -the fre- 
quent brief "forms" you will be asked to,, complete *are our way 
of.- helping to get a clearjjxlea of the strengths, and weaknesses 
of". the duplex TV technique?-as an educational^ tool / 

Because we would prefer much of the evaluation, have the 
freedom that comes with anonymity, we are assigning each par- 
ticipating teacher a code number, which will be used through- 
out the project. You will find your code number in the- top 
right-hand corner- of this letter. Please detach this number 
anct always* use your number in responding^ to the evaluation 
tests and questionnaires, starting with this one. 



Sincerely, 




Presiden 



1. Code# 



2. Age 



5.' Grade taught 




4. Highest- Degre4 Earned^ 



AreSTof.; specialization, 'if any_ 



7. Y ^ rs y° u have taught this grade_ 
9 . '"Years in this school system (a) 



8. Years in this school 

9. Total years of teaching (b) 



10. Brief ly^state ypur involvement in career education: 



yes 



J- 



no 



11'. Have you had any career education training? 

12. If "yes," please answer following: (a) Number of forfnal courses 

(b) Number of workshops or "short courses" 

13. Have you reacL-boeks or articles dealing with career^ education? yes 

- ^V5) Number of books (c) Number of articles 

14. Have you liad inservice training courses in any area? 

15. Have you had any. previous experience with educational TV? 
ib) If "yes," describe briefly: __ 



yes 



no 



j^es 



16. Have you had any previous experience with duplex TV, as used in this project? 
rri ?^. y es no (b). If "yes," describe briefJLy:_ 
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17 v Please list 3. things you #re hoping to gain from participatioa iii 
^ this training* , frBe as specific as- you can.) \ ' 

/ _ \ ' » " t 4, i a. » m 



<a) ■• . • ■ " j 

"(b) 5 : r 



18. Check (to'thje left) the one you consider most important. r 

19. Brief ly. define career education as you would describe it to a parent-of one 
1 of your students: % 

, i « 

20. Have you ever used special career education curriculum materials in your 
classroom? y es no 

21. H.ave you ever" personally developed -any career education curriculum material 
y es * no . ' 

22. Is qareer education taught in your school now? . * y es • < no 

23. If "y^&, " is it being taught:, (a) as a separate class * *- 

(b) £S-^aV ; part of several subject arqas 

a>s the teacher feels it's needed • , „ 

24. On each characteristic below, describe, the student that you would see bene- 
fiting most from career education, (check one for each line) 

(a) - Male Female Either* > * 

(b) _Elementary student , Jr. High student High scho 

(c) Academically orienteH vocationally oriented ■ 

(d) Prom a "blue collar" fami-ly Fcom a "white collar" .ho 

# (e) . From the Anglo ethnic group From a minority group 

25. What are your expectations from this type of, training?. How would you cpmpa 
its effectiveness with other types of inserviCe training? j * > 

, > : = ; < =— = r% 

26. The iTiajor empha siskin career education is toward: ~ ~ X 

■ (a) Vocational education (c) Special students ' 

Mh) College 'bound students # (d) All students • * 

27. Approximately what percent of Texas' student, population drops out of formal 
education each year? (a) 5% (b) 44% (c) 20% (d) ,13% 

2*8. The emphasis of career education in the elementary school i^ on: 

(a) Awareness (c) Experimentation 

(b) Exploration (d) Preparation' *». 

29. In this decade approximately what percent of the jobs will require a colleg 

education? (a) # 50% (b} 5% f_{c) 75% (d) 20% 

3(5. One of the methods 'used tta cftoup ,all jobs into categories is: 

(a). Professions * ^ f (c) Job Clusters 

(b) Trades (d) Job Description 



31. What models of career education does Texas emphasize? 

: ^ (a) Community-home r based model (c) Rural-residential iqodel 

V (b) School base£ model - (d) .Employer based model 

32. Career education is another term for vocational education, (true^or fal: 

33. O ne, of the main purposes of career education is to get students to make 
fairly' definite career choice in elementary or junior high school. (T or P) 

34. T he best way to teach cajeer education is by teaching it as a separate 
course at -each grade level. (T 6r F) 

35. Tlie fundamental concept of career education is that all educational exp< 

ences should be geared to preparation for economic independence, personal f\ 
filltaent, and an appreciation ffer the dignity of work. (T or^F) * - fp^o' 

36. In the schools, career education is the responsibility of only teacners* 

37. I personally (do, do J£$t)' beLieve that career education is needed in^ school: 

38. 4 I believe that c^ee'r^Jkiucation * (docs , doesn't) need to be taught , in my 
school district. (cir,c¥e correct answer in #37-39) 

39. I *think that career education (will, will not) be a concept that will be a 
permanent part .of the schools. of the future. 

PLEASE RATE THE FOLLOWING ITEMS ON A SCALE FROM ONE TO FIVE, IN ORDER OF IMPORTA1 
IN CARRYING OUT A SUCCESSFUL CAREER EDUCATION PROGRAM*' (5 = most important) • 

4n ^ M 9e,of printed materials , 4 3, use of career games . 

£flj£ 5e of tape recordings 4 4. Use of field trips 



jse of video tapes ' \ 3? 4 5. 'Use of refioiyrje ' speakers 




• Appendix B 

^EDUCATIONAL DEVELOPMENT CORPORATION 
2813 RIOCRANDE • , -30 October 1974v; 

AUSTIN, TEXAS 78705 r £ 

- EVALUATION QUESTIONNAIRE ." . • f ' 

You have now participated in two "sessions" of Project INTERACT. Please' an- 
swer these questions, based on your overall ei^eriences so far. 
1. Code # 2. Have you enjoyed this participation? ;_yes no 

3. Do you feel that the technical equipment ' has : (check one) 
worked very well all the time?. 
' b een mostly satisfactory? , . • , ' - 

had a. large number of problems? • * , • 



• been highly disappointing? 

4. Did you personally ask any questions or make any comments while "on the ail 
"* . yes n o \ ; 

5. Did you find the material presented: (check one in each column)' 

helpful? _new? • , ! 

. "ok, but not relevant? a little familiar? 

'"mos'tly useless? • jKfc "old hat"? 



. 6-. Would you say that you would probablpuse anything shown in this project 11 
your classroom? yes no * 

7. Did you find the format and physical arrangements: (check one) j 

comfortable? clumsy or distracting? ^ »t. j 

acceptable? d iscouraging to interaction? 

8. Wow would you compar^ the duplex TV technique in-service training (so far); 
with: (a) v/orkshops? workshops .better ' ,\ 

same ' 

'"duplex TV better 

(b) training films better 

film--? same • se 

turns. duplex TV better , * 

\ tape-slide or filmstrips better 

(c) tape-slide or same 

filmstrips? duplex TV better 

9 Which of' these statements comes closest to describing your present opinion 
of this training experience? (check one) 
' (a) It needs to improve 

3 (b) it's really great so far, . t 

(c) The material is fine, but the technique is a problem* 

(d) JCt's mostly a waste of time. 

(e)jfe»e -technique is interesting, but the subject matter is only so-s< 

, ' (f) it's probably the best they can do, 

10. What is the single most useful. thing you have learned from this Project so 

far? . I : 

— 5 . % \ 

r 

11. -What is the 'single most obvious fault or . shortcoming of this Project so fa 

: . a- „ • . 

12. Can you suggest anyting that would help to improve the presentations, or 
make you feel better about the time you are spending on this Project. __ 
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* 

♦TO: Teachers participating in P^gx-ject INTERACT 

You have^recently attended two project sessions that were different in 
many ways from the first two that we asked ybu to evaluate previously. 
Your response to this questionnaire will be especially valuable in 
planning "future programs. . 



Code # (If you do not* have a code number, please check with 

your Project Facilitator.) 

1. „ In comparing the first two programs with sessions 3 and -4/ please 

check one of- the following: 

(a) I prefer the "information" approach of programs 1 & 2. 

(b) I prefer the "demonstration" approach of programs 3 & 4. 

(c) To me the two approaches ar$ equally effective. 

v 

* . 

2. Please check one of these statements about the interaction format: 

(a) I was satisfied with the way the 4-nteraction was' handled 

in the first' two programs. 

(b) I liked the "continuous" interaction 'in programs 3&4 bette: 

(c) I have no real preference in this matter* 

3. Please' check any of the *f ollowing that apply concerning the materials 
• packets you -have " been receiving:' 

c omplete not very helpful 

useful m ostly a waste 

' incomplete , not really necessary 

* mainly good as a resource 



Any comment you would like to make: 



4. ' Please check any of the following that apply concerning the activities 
demonstrated in programs 3 & 4: - 

; useful ^ no t relevant to my classroom ne< 

not clearly presented ^stale or over-used 



to ° simplistic require unavailable materials 

5. Do you find it difficult to find appropriate activities for the grade 
level of your class? . yes nQ (grade , tau g h t > 

6. Considering your experience in the Project so far, please check all 
the following that describ.e your opinions. 

(a) The TV interaction is: effective 

too hurried ^ 

coiff u sing 



O ' Other (describe) 



r 



■1 " ■ 

i ,(b) Passing the microphone around is; 



f'(c) Talking on camera is: 



too % troublesome 
^distracting, 
not too bad 



Other (describe) i t 



frightening 
^inhibiting, 
fun 



getting easier 



Other- (describe! 



(d) . I would like more interaction: " yes 

(e) I am more interested in speaking with: 



no 



the presenters 
teachers in other sit* 



(f) Compared to workshops ^ the amount of interaction generated is: 

* * ' m ore 

less : 

* a *' s it ^ the same 



(gj The ene-Tiofcr period is: 



1^ 



_about right 
too rushed 

cfcowded s^ith too much 



material 
_-too long 
too short 



Other (describe). 



What will you be looking for in future programs? 



What specific things would you change or do differently in the progra 
you have^ attended? ; • 



TO: Teachers participating in Pro j ect.JENTEKACT j 

Yo\} have now completed programs 5, 6, 7, and 8 of the Project. Please an- 
swer the first 5 questions about these four programs only . 



Code # r « ' 

1. Did you find the material presented: (check one ■ in each column) 

helpful? ' new? 

OK, but not relevant? , ,a little familiar? ^ 

mostly" useless?" "old hat"? 



5 . v . ■ 

2. Would you say that you. would probably use anything shown in these 4 
programs in your classroom? yes no 

,* ■ , \ 

3. Did you find the format and physical arrangements ; (check one) 

• comfortable? . ' ; clumsy or distracting? 

acceptable? • ^discouraging to interaction? t 

*4 fc What is the single most useful thing you have learned f from these 4 pro- 
grams? ; : : 

• • * 

v — f 

S. What is the single most obvious fault or shortcoming of these 4 programs 



Now please answer the rest of the questions which you will find familiar! 

6. On each characteristic below, describe the student that you would see be 
f'iting most from career education : (check one for each line) 

(a)- Male Female • ^Either 

(bj - Elementary student Jr. Hxgh Student High School 

; (c) "A cademically oriented Vocationally oriented 

(d) ' ., From a "blue collar" family ; From a "white collar" home 

(e) V F rom the Anglo ethnic group From a minority group 

7. The major emphasis in career education is toward: (check one) 

(a) Vocational education ' _(c) Special students 

. % (b) College bound students' (d) All students 

8. Approximately what percent of Texas' student population drops out of fc 
mal education each year? (a) 5% ; (b) 44% (c) 20% (d) 

9. The emphasis of career education in the elementary -school is on: 

(a) Awareness (c) Experimentation 

(b) Exploration . (d) Preparation 

10. In this decade approximately what percent of the jobs will require a c 
lege education? (a) 50% (by. 5% (c) 75% (d) / 20% 



ERIC 



41 



11'.- One of the methods used to group all jobs into categories fs: 

(a) Professions (c) Job Clusters . 

(b) Trades (d) Job Description 

12* What .model of career education £6es Texas emphasize? 

(a) Coimunity-lidme based ni6del : (c)' Rural-residential mo< 

(b) School based model . (d) Employer based model 

13, Career education is another term for vocational education, (true-fal: 

14* One of the main purposes of career education is to get students to mak< 

a fairly definite career choice in elementary or junior high school. ( f 

• . * ' 

15. ' T he best m way to teach career education is by teaching it as a* sep- 

arate course at each grade level. (T or F) , _ 

16. The fundamental concept of career education is that all educational 

experiences should be geared to preparation for economic indepen- 
dence, personal fulfillment, and an ^appreciation for the dignity of 

* work. (T or F) 

17. In the schools , * career education is the responsibility of only tea- 
chers*. (T or F) _ 

18. I. personally (do, do not) believe that career education is needed in sch 

19. I believe that- career education (does, does not) need to be taught in 
my school district-. , 

20. I think that career education (will, will not) be a concept that will be 
permanent part of the schools of the future. 

PLEASE RATE THE FOLLOWING ITEMS ON A' SCALE FRO:i ONE TO FIVE, IN ORDER OF II1PO 
TANCE IN CARRYING OUT A SUCCESSFUL CAREER EDUCATION PROGRAM (5 =^most import*! 

21. Use of printed materials 24. Use of career games ■ 

22. Use of tape recordings x '25. Use of field. trips 

23. Use of video tapes . 26. Use of resource- speakers 



r 
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Appendix E 




EDUCATIONAL DEVELOPMENT CORPORATION 
2813 RIO GRANDE 
AUSTIN, TEXAS 78705 



1 



(512)476-6868 . 
476-5419 



I March 19,75 



'Dear Teacher: 

The programs offered in Project INTERACT are now completed , and we -need- an 
overview from you to complete our evaluation. Please answer these questions 
from the point of view of your total experience in the Project, V7hen you 
have completed the form, please send it to us the stamped self-addressed 
envelope provided. / 

. f 

Thank you for your help — it has been a valuable source of evaluation materia 



Sincerely, 




President 



Code # 



Number of the eight programs you h^ve attended^ 

1. Have you enjoyed this participation? yes no 



(check one) 



2. Do you feel that £he^fcechnical equipment .has; 

worked very w&ll all *the, time? 

been mostly satisfactory? 

► had a large number of problems? 

been highly disappointing? 

3. Did you personally ask any questions or make any comments while "on the 
" yes m 1_ 



no 

4. How would you compare the duplex TV technique in-service training with: 

^workshops better 
""same ♦ 
"duplex TV better 
'films better 
"same 



(a) .work shops? 

(b) training filtas? 



(c) tape-slide or 
f ilmstrips? 



duplex TV better 



tape-slide o? filmstrips better 
~s ame 

"duplex TV better 



5* Which of these statements comes closest to describing your opinion of 
this training experience? (check o£je) 

(a) It needs to improve* 

(b) It was really gr^at, 

(c) The material was fine, but the technique is a problem. 

• (d) It was mostly a waste of time, 

(e) The technique is interesting, but the subject matter -was only so- 

(f) It was probably the best they could do, • 

6. Please check any of the following that apply concerning the materials 
packets you received: 



complete 



^useful 
incomplete 



not very helpful 
mostly a waste 



not really necessary 



mainly good as a resource 



Any comment you would like to make: 



7, Please check any of the following that appj.y concerning the activities 
• demonstrated: 



8. 



useful 



not clearly presented- 
too simplistic 



V', n ot relevant to my classroom needs 
stale or over-used 

4 

require unavailable materials ts= 



Did you find it difficult to > find appropriate activities for the grade 

level of your class? yes no (grade taught r ) f 

• > 

» < 
Considering your experience in the Project, «please check all the follow- 
ing that describe your opinions* 



~ (a) The TV interaction was: 



effective 
'too hurried^ 
"confusing 
"other (describe) 



(b} Passing the microphone 
around was: 



V 



_too troublesome 
^distracting 
jiot too bad 
other (describe) : 
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(c) Talking on camera was: " ' frightening 

* 

inhibiting ■ 

. * fun 

getting easier 

Other (describe) : 



(d) I would have liked more interaction: yes no 

(e) I was more interested in speaking with: 

^ , the presenters 



teachers in other sites 



(f) Compared to workshops, the amount of interaction generated was: 

more 



less 

v 

the sane 



(g) The one-hour period was: about right 



_too rushed 

^crowded with too much materia; 
too long 

too short 



Other (describe) 



*10. V7hat specific things would you change or do differently in the programs 
you have attended? . 



11, Did participation, in this project fulfill the hopes you had for it at t\ 
beginning? f * 

yes n o " partly 

12, What specific aspect of th'is training experience would" you particular- 
ly praise? « * 

, ! : \ — 



13 + V7hat specific aspect of this training experience would you particularly 
like to. criticize? • 

. ; • V 

14 • Was your Facilitator (check any that appky) • 

a real help? • not much help? * .'~ 

essential to the Project? not really that necessary? 

a little .too "bossy"? not enough of a leader? 



15* Would you recommend that this kind of inservice training be 

developed further? 

^ d ropped? 

used extensively in its present form? * 



16. Any additional comments: 



PLEASE COMPLETE AND MAIL BY 15 -M A R C H* 
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Appendix F 




EDUCATIONAL DEVELOPMENT CORPORATION 
2813 RIO GRANDE 

AUSTIN, TEXAS 78705 f 



October 15, 1974 



(512)476-6868 
476-5419 



This organisation will be evaluating Project INTERACT during th£ 
entire course, and we have two ob jective&r-to improve ti^e course 
duping the cycle, if possible; and to aid in later decision- 
making about. the utility of this method of training. 

AS a facilitator working with Project INTERACT, you are in a key 
position to help in the evaluation process. Your perceptions of 
the strengths and weaknesses of the INTERACT approach, from both 
technical and educational points of view, will be most valuable, 
and your assistance is earnestly requested. To provide some pre- 
liminary information, it would be appreciated if you tfould answer 
a few brief questions. Thanks! — 

Sincerely, 



Dorothy 
President 




Fruchter, Ph. D, 



1. Name: 



2. Age: 



3. Sex: 



4. Position: 

5. How long have you been in this job? (a) 



in this school? (b) 



In this scnool system? (c) 



6. Briefly describe your involvement in. the area of career education: 



7. 

a. 
io. 



Have^you had formal training in 'Career Icucafcion? (a!) yes 

Number of university or college courses : (b) f 
Number of workshops or .qther snort* training experiences: (c) 



no 



9 
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Have you previously, served as a discussion leadkr in any educational 
context, other than alementary classroom? < \~ y es no 

Have you had any previous experience or contact* with .the duplex TV methoc 
of presentation? \ yes no I 

If your answer to #9 was "yes," would you 'describe this contact as: 

(a) generally positive, givirig an impression of consider- 

• - m able educational promise; 

" (b) neutral, with the cpod and bad aspects about equal; # 

■ (c) generally negative, with too many problems to allow 

for real ef fectiveness, • 
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Appendix G 




EDUCATIONAL DEVELOPMENT CORPORATION 
2813 RIO GRANDE ' 
AUSTIN, TEXAS 78705 



7 March 1975 



The presentation program of INTERACT is over, but our in- 
terest in it lingers oni And We hope yours' does too. 

Seriously, we need your help "to make a worthwhile evalua- 
tion and to arrive at , useful conclusions and recommenda- 
tions. We recognize that the Facilitators probably had a 
strong influence on how the teachers feel about the project, 
so knowing how you feel will help us to analyze the whole 
outcome, an<? possibly to understand why. 

We have decided against .a simplistic .form, to fill out. 
Rather, we'd prefer that yo\i just put down your feelings 
and observations on paper and send them to us. Of course, 
we 1 11 have to read each response carefully and iet it sink 
in — not make a statistical number of it. If you'd -rather 
talk on a t^pe 'cassette, that will be equally acceptable; 
we'll transcribe it and return the tape to you. 



Here are some things we'd like "you to cover, but you are / 
not limited to these, by any means. 

1. Please identify yourself- and remind us of your posi- 
tion and school. 

•2. Comment about the "content of the whole course — its de- 
velopment, presentation, intelligibility/ etc., as dis - 
tinct from % the technical methodology . 

f * 

3. Please tell us Tiow you feel about duplex TV and the use- 
fulness of interaction, feedback, discussion, etc. 

4. % Make an estimate of the percentage of teachers who 

(a) really enjpyed the project; 
/(b) got much from, it; 

(c) will utilize: a significant quantity of suggestions^ or 

(d) woXild rather have been* -doing something else. 

* 

5.,* Tell us whether you think the whole" idea of duplex TV 
with interaction is worth tryinq to improve, .or whether 
we would be throwing good money after bad. 

6. Add* anything else you'd like to say about project 
"INTERACT and your part in it.. 

Please consider these in whatever context, or to any depth 
you'ef like. We* truly want your*frank views and uninhibited 
concerns. Naturally , * we will not reveal sources 'to any * 
persons outside, this corporation. * ' 



Thank you very muoji for your help. 
Sincerely, 



9 
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Dorothy A. Pruchter, Ph. D.. 
Enclosure; return envelope 
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EDUCATIONAL DEVELOPMENT CORPORATION ^ 
2813 RIO GRANDE ( , • 

AUSTIN, TEXAS 78705 

Appendix. H 

(512)476-6868 . . ^ 

• 476-5419 \j 4 30 October 1974 < 

./.Dear Friend: _ 

Some of the 'teachers in your community, are participating in Project 
INTERACT, a new venture in educational use of television technology. 
Because the w^ole concept is innovative, a considerable amount of 
evaluation will be necessary to get the .maximum benefit from the 
project. Your help is needed, mostly to provide control and "base- 
linfe" information. We would appreciate your filling out this form 
on a completely anonymous basis. 

thank you, 

r 



Dorothy AV Fialchter, Ph. D. 
President 



1. Name of school t ; 2. City 

'3. Position ^ If* teacher, grade taught (b) 

area of specialization, if any (d) ' ' 



years you have taught *this grade {d) 



4.' Age 5. Sex . 6. Highest degree earned 

7^ Years in this school^ 8. Years in* this school system 

9. Total years in school-related employment 

10. Have you had any "career education" training? yes no 

11. If "yes," please answer the following: (a) number of formal courses 

,s (b) number of workshops or "short courses" * 

c : 

12. Have you read btfoks or articles dealing witK career education? yes 

• (b) number of books (c) number of articles 



13. Have you had inservice training courses in any area? yes 

14 . Have you had any experience' with educational TV? yes no 

• (b) If "yes," describe briefly: ' * * • 



15. Have you had any expedience with duplex TV? " - y es no 

(b) If "yes,*" describe briefly: ; ] 



16. Briefly def ine"career education" as you would describe it to a parent of on 

. of your students: , , 

j 

• • 
17* Have you ever used special career education curriculum materials in your 
clasferoom? ^ yes no 

Irnfr-ve you ever personally developed .any career education curriculum material 
yes no 



19*. Is , career education taught in your School now? _ i ^yes n o 

20. If "yes," is it being taught: (a)-, as a separate class #% 

■ ; (b) as a part o£ several* subject areas 



(e) as the teacher feels it's needed 



21 # On each characteristic below, describe the student that you would" see bene 
fiting most from career education, (check one for each line) 

(a) Male Female ; ' Either 

(b) Elementary student _ Jr » High student Hi scho 

CO Academically oriented \ * V ocationally oriented , 

(d) From a "blue collar" family j From a "white collar" horn 

(e) From the Anglo ethnic* group .From a minority group 

22; .The major emphasis in career education is toward: (check one) 

(a) Vocational education (c) Special students ■ * 

(b) College bound students (d) All students 

23. Approximately what percent of Texas 1 student population drops out of fornia 
education each year? (a) 5% (b) .44% (c) 20% (d) 13% 

24. The emphasis of career education in the elementary school is on:- 

(a) Awareness - . (c) Experimentation 

(b) Exploration ' ' (d) Preparation 

25. In this decade approximately what percent of the jobs will require a colle 
education? *(a) 50% (b) 5% (c) 75% (d) 20% ^ 

26. One of the methods us6d to group all jobs into categories is: \ \ 

(a) Professions (c) Job Clusters x j 

(b) Trades ^ • (d) Job Description / 

- \ ~ — ■ — • J 

27. What model of career education does Texas emphasize? j 

(a) Community-home based model (c) Rural-residential models 

(b) School based model r (d) Er^ployer based mbdel ' j 

28. Career education is another term for vocational education. (T^ue or Faj 

29. One of the main purposes of career 'education is" to <get students to mak| 

a fairly definite career choice in elementary or junior high school* (T or : 

30. [The best way to teach career education is by teaching it as a separate! 

course at each grade level. (T or F) *j 

31. The fundamental concept of career education is that all educational ex* 

periences should, be geared to preparation for economic independence , persoi 
fulfillment, and an appreciation .for the dignity, of work. (T or F) j 

32. In the schools, career education is the responsibility of only tea<^Se?| 

33. I personally (do, do not) believe that earner education is needed in school 

34. - I believe that career education (does, doesn't) nped to be taught in my 

school district. - 

35. I think that career education (will, will not) be a \concept tha?t will be a 
permanent; part o"f the schools of "the future.. 

PLEASE RATE THE FOLLOWING ITEMS ON A SCALE FROM ONE TO FIVE, IN 'ORDER' OF IMPOR- 
TANCE IN CARRYING OUT A SUCCESSFUL CAREER EDUCATION PROGRAM (5 = most import ani 

36. Use of printed Materials 39. Use of career games \ 

37. Use of tape recordings 40. Use of field trips I 

38. Use of- video tapes , 41. Use of resource "speakers j 

ERLC r ^ . 
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EDUCATIONAL DEVELOPMENT CORPORATION 
2813 RIO GRANDE 
AUSTIN, TEXAS 78705 ^ 



6 November 1974 



(512)476-6868 \ 
476-5419 

TO: Members of the Project INTERACT Advisory Panel 

FROM: D. Fruchter, Ph. D f . , President of Educational Developlifent Corp # 

Thank you for takinc^ome time from your busy schedule to help us in the 
evaluation of Pro jeqP^jffERACT. Your insights, comments, and criticisms 
" will 'be an important 0Kfor in seeing that maximum benefit is realized 
from this innovative efTbrt • The questionnaire below will give us some 
background information.. In addition, you will be asked to complete a 
hrA ff critique *af ter each of the four videotaped presentations you will 
rimitor, well as an overall assessment ,at the end of the last presen- 
tfftipn. please kee^p in mind that we are' evaluating both the " educational 
content (career education) and the presentation method <live duplex tele- 
, % vision); in the latter case, we hope to be abl6 to assess its value for 
in-service teaching training and speculate about its probable worth for 
teaching children/ Please feel free to mak'e suggestions about anv aspect 
of thogl project, including tfie evaluation process and ins'trumentp. Vie 
need "and appreciate your input-, 'Ple&se return this at'the first session 
of the Advisory Pan e&*- that you attend. 



1 • * Nartie 



4. Highest £egtee_ 
6. Major subject 



_^ 2* Age_ 

5. Vfhere earned 



3 . Sex 



7. Present position 



8. Briefly describe your present or past involvement: with career education: 



9. Briefly describe your present or past involvement with educational tele- 
vision: ] 9 , • 

lo. Briefly describe your present or past, involvementlwith educational app] i- 
cations of audiovisual media fether than television: -\ 



.(If none, check here: 



T 



11. Briefly describe you^r present or past involvement with workshops, seminal 
or ether "live" educational techniques: [ , 



(It* none/ cheH: hero)' 



T 



nc 



JL2. Have you had experfence specifically involving dupllpx TV? 

♦ 13. Have you ever been- a classroom teacher on any level? yes 

. 14* Have you had any previous contact, with Project INTERACT materials? 

yes no (If "yes", briefly describe: j~ , 

o - : __> 

IriSL^ : Please, continue on reverse, as n ^? ess %£«£' ^ or 3 ri y of at * ove items* 
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INTERACT Presentation^ 
Date: 



ADVISORY PANEL CHEC&LlST-CRITIQUE 



You have just monitored two videotaped INTERACT presentations. Based on 
your immediate impressions, please complete the^ following: * 

^ r •* ' Segment 1 , Segment 



1. Name X _ 

2. Would you describe your overall reaction as: 



As far as the subject matter is concerned, 
3t the presentation was: 



; positive? 
neutral? " 
negative?^ 

outstanding 
adequate 
spotty 
poor 



4. the material was: 
. (Check 1 of fcfle 
2 possible re- 
sponses for each 
letter for both 
segmqfats 1 & ..2, ) 



. * mostly helpful 
* ' generally treeless 



(b) 



(c) 



(d) 



appropriately aimed ' i 
off-target 

mostly 'fresh .And~ innovative 
somewhat old-hat < : - « 

'stimulating 



often boring , * * 

, . clear and well-organized 

[ e * diffuse or poorly integrated 

From a technical § point of view, 
5*. the picture quality was: 



^. the^ camera work was: 
the mixer m control was:J 



(a) 



(b) 



outstanding 
adequate 
spotty 
poor 

an- afeset 
a drawback 

smooth 
clumsy 

logical* 
disjointed 



8, What was, in your opinion, thfe best feature of the sub'jeqt matter presen- 
tation? ■ (Segment 1) * i ; 

(Segment <i2 ) i , ♦ . 



9. What was, in ypur opinion , the "least, satisfactory " feature of the subject 

matter presentation? '(Segment 1) , ¥ 

(Segment 2) ; 1 



' 10. What do you* feel was the best technical achievement of the segment? 

(Segment 1) : , . 

(Segment 2) t s 



11. What do you regard ^as the worst aspect of the technique in this segment? 

{ Segment 1) ' , ; ( . 

(Segment 2) J_ » . 

O • Z s 
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* # * j 

' i 

12. Please giv.e your comments about the handling of thk discussion periods 

(if they" were, in fact, recorded 'and, presented) I 



— * ~ « > - « i 

13* If you have any suggestions for changes in the'se presentations that might 
enhance their future usefulness, please lis % t them: 

(Segment 1) [ . \ ; 

(Segmfent 2) . ' - 

14. 'if. you have 4 any suggestions for changes in the style, tone, or level that 
might be applied to the remaining/ still uncompleted, segments, please 
mention them -here. ' * 



Additional Comments: 



V 



0 
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Appendix K 



V 



* INTERACT Presentation^ 

Segment 1_ 

Date: - , 



ADVISORY PANEL. CHECKLIST-CRITIQUE 



*¥ou have just monitored another videotaped INTERACT presentation. Based on. 
your immediate impressions, please complete the. following: 

* 1 . Name , ] 

2. VJould you describe ydur overall reaction as: (check one) 
positive? \ n egative? ' * 

Other? ' c • 



neutra*? 



3. As far -as the subject matter is concerned, the presentation was: (check 
one of more) 



out^anding 

'adequate 



spotty 
pofcr 



^Qther: 



P3^pase give specific comments: 



4., As far as the subject natter is concerned, the, material was: (check one of 
tfie possible responses for each letter) 

. m ostly helpful 

(a) generally useless (d) 

* Other: 



<b) 



(c) 



appropriately aimed 



^ off-target 



'Other: 



jnostly fresh and innovative 

^somewhat old-hat 

"Other:- / ■ 



•(e) 



stimulating 
"often boring 



Once again, please give specific comments: "(f) 



•Other: 



clear and well-organi?,e 
""diffuse or poorly integra 
"Other: 



5. What was, i& your opinion, the best feature of the subject matter presenta- 
tion? . 

6. What was, in your opinion, the least satisfactory feature of the subject 
matter presentation? ; ' - * 

7. * From a technical 'point of View, the) picture quality was: (check 1 or more) 

.o utstanding spotty 

\ adequate 
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Other: 



poor 
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8* From a technical point of view, the camera work was: (check one) 
an asset a drawback 



Other: 



9. Prom a technical point of view, the mixer cohtrol Vas: (check one each fro 



Vas: 



(a) siftooth 

clumsy 

Other: 



(b) 



logical 
"disjointed 
"Other: - 



1 • asb) 



10* Please give specific comments about the overall technical achievement: 



11. What dc you feel was tl^e best technical achievement of the segment? 



12. VThat do you regard as the worst aspect of the technique in this 'segment? 



13. Please give your comments about the handling of the interaction shown. 
: : . . . jk ■ 

* * u 

_ , ; \ * : 

/ 

f 

14. If you have any suggestions for changes in this presentation that night en- 
hance its future usefulness, please list them: 

r ■ 

\ ^ I 

15. * If you have any suggestions for changes in the style/ tone, o^ level that 

might be applied to the remaining, still uncompleted, secnents, please 
mention them here. _ y*j_ - 



.6; ^Please , comment on the obvious, difference between ,thi^ segment and nos* 1 
and*2, seen in 'the last screening session. 



Additional Comments: 
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INTERACT Presentation^ 

Segment 

Date: 



ADVISORY PANEL CHECKLIST— CRITIQUE 

You have just monitored another videotaped INTERACT presentation* Based on 
your immediate impressions, please complete the .following: 

1 • Name * 

2/ Would you describe your overall reaction, as: (check one) 

. p ositive? negative? 

neutral? 



Other? 



3. As f^r as 4 the subject matter is concerned, the presentation was: (check 
one or more) 



^outstanding 
adequate 
Other: 



spotty 



poor 



Please give specific comments: 



t /9t ■ * i 



\Q i . • . U ! it 



4. Vfts far as the subject matter is concerned, the material was: (check one of 
the possible responses for each letter) 



(a) 



jnostly helpful , 
^generally useless 
Other: 



(b) 



(c) 



appropriately aimed 
"off-targfet 
Other: 



mostly fresh and innovative 
^somewhat old-hat 
Other: 



(d) 



stimulating 
"often boring 
"Other: 



(e) 



clear and well-organize< 
"dif f use.or poorly integra' 
"Other: 



Once again, please give specific comment^: (f) 



5. Whatvas, in your opinion, the best feature of the subject matter .presenta- 
, tion? *^ > * , - . 

5 ■ ■ ; 

6. What was, in your opinion, the least satisfactory feature of the subject 
matter presentation? \ 

7. From a technical point of view, the picture quality was: (check 1 or more) 

. outstanding * spotty > , • ) 



_adeqUate 
Other: 



pobr 
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8* From a technical point of view, the camera work was: (check one) 

an asset _ ^ a drawback 

'• ' Other: 



9. From a technical point of view, the mixer control was: (check one each frb 

' a&b); 



\ smooth . 

_clumsy \\ 

Oth e±% J 



(b) logical 

disjointed 



Other: 



10 . Please give specific comments about the overall technical achievement: 



11. What dc /you feel was the best technical achievement of the segment? 



>12. What do'you regard as the worst aspect of the technique in this segment? 



13* Please, gi^ye youi; <cjgflients ai^out the handling of the interaction sHown. » 



14. If you have any suggestions for changes in this presentation that miaht en- 
hance its future usefulness, please list them: 



15. If you have any suggestions for changes in the style, tong^'or level tr 
might be applied tb the remaining, still uncompleted, segments, please 



that 
e 



mention them here. 



Additional Corfunents: 
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• Appe'ndix H 

EDUCATIONAL DEVELOPMENT CORPORATION 
2813 RIO GRANDE ' 
AUSTIN, TEXAS 78705 
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(512)476-6868 
476-5419 



25 March 1975 



TO: Members of the INTERACT Advisory Panel 
FROM.: > E>ee Fruchter 

i 

First, we want to express our sincere gratitude for your con- 
scientious and helpful service on this panel. The experience 
has not always been painless far you^ and this makes your 
willingness to help all the more impressive! 

There are just a few more questions about this effort that 
we Would like you to consider and respond to, and this will 
require some change of set, including at legist sone "suspen- 
sion of disbelief 1 " * 

* 

After conversation with John Etheredge, we would like to pro- 
pose the following as at least strong hypotheses, and then- ask 
some 'responses based on them: ^ 

1. The technical problems could largely be solved with a 
money commitment that would support two technicians and 

# . one coordinator, full time. 

2. There is statewide, national, and even international in- 
terest in the future of duplex TV. 

3. The interaction, as experienced in the studio, was not 
available on the tapes, becausfe the audio wiring did not* 



allow for i 4 * 



4. 



\ 



5.' 



The present situation in the development of the grid is 
a little 'complex, in that technical dependability inust 
proceed before prograanming can be effective, but programs 
must be available before money will be spent on technical 
improvement. - % 

The tapes this panel reviewed are not, and were not in- 
tended to be, products , and their utility is largely for 
evaluation. ft - . 



Lest you feel ,that we're framing a preconceived ".patron- the-back B 
evaluation, be advised that we're not. Bit we don',t want a few 
■unfortunate events to cloud objectivity. So, with these factors 
in mind, please address yourselves to thes£ few .questions, place 
the completed form in the provided . envelopes , and send it as soon 
as possible. Thanks again, in reLrospefct an4 in advancel 
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Questions ; . t 

1. What would be "your priorities in further development of this concept 



2. Hov; could you -«ee the duplex grid best serving the TEA? 



Assuming that tf'hle techhical difficulties can be overcome, and that 
good programing is available, what do you see as the ma^or advan- 
tages and disadvantages <j>f the telecomputer grid to education in 
eastern Texas? n 



4. , How do you compare this technique of training and education with 
m other methods such as: self administered programmed instruction; 
conferences and* conventions; wbrkshops; instructional films in 
groups; exploratory and discovery xrroups; combinations of these? 
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EASE ATTACH ADDITIONAL SHEETS , AS NECESSARY. 
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EDUCATIONAL DEVELOPMENT CORPORATION 
2813 RIO GRANDE 
AUSTIN, TEXAS 78705 



(512)476-6868 22 January 1975 

416-5419 

PROJECT INTERACT 

EVALUATION GUIDELINES FOR INTERVIEWS AND/ OR OBSERVATIONS _ 

In an effort to give some structure to your observations and in- 
sights, the following questions are offered. (Of course, all 
comments are welcome—these are only a few of many areas of in- 
terest.) Note that these items are presented as a guideline tor 
topics to~be~covered in the interview, rather than as a rigid 
format for interviewing. Ideally, the interview should be con- 
ducted informally, without reference to this form while speaking 
to the participant, and comments and observations should be noted 
on this sheet after the session. 



1. How is the technique Working? 



2. Does the "production" get in the way of the "training" for 
the Killeen audience? ■ Comments: ; . 



3. Are the teachers really responding to this training experi- 
ence? Comments : . ; 



4. In your opinion, is the duplex TV technique «compa ring favor- 
ably with "live" workshops?_ 



with other media method's? 
Comments : 
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5. How effective is the facilitator! in encouraging interaction? 
— j 1 ■ : 

£ ■ » ■ , - :-■ 1 1 r- .. 

(This impression is mostly, based on . observation 

V. interview.) {check one > 

6. Could you make any statements conqprniag" the sense of involve- 
ment of t\\§, local participants?^ - * ' $ 

of the teachers at other sites? 0 



7. I* you feel that direct observation gives a different impres- 
sion from videotape screening? Comment: * 



* * * * * * * * , 

GENERAL OBSERVATIONS 'AND COMMENTS: 
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'Appendix 0 ' 

. / 

The regular. members of the Advisory Panfel were: ^> 

Robert Collinson 2 
R* C. Fisher 
George Lipscomb 
Reeve Love 

Walter Rambo * 
Lucille Savage 

Wanda Stedman ' 
JJen Teague 
Marvin Veselka 

The folTowing attended one or more of the sessions 'and completed checklist 
critiques', but the main portion of the cited input came -from the regular 
"panel members: ' • • 

Dorothy A. Fruchter , 
Gary Haseloff 
George Higginson 

Margaret Lindsey \ ^ 

Martha Westbrook 
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